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This  work  was  performed  In  support  of  Task  No.  2003  -  Pilot  Plant  Scale-Up 
and  Processing  Techniques  of  the  IMAD  High-Explosives  Project. 

The  algorithm,  presented  in  this  report,  is  ideally  suited  for  the 
evaluation  of  the  homogeneity  of  solid  mixtures  of  explosives  and  propellants 
produced  in  batch  or  twin-screw  mixers. 
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INTRODUCTION 


When  we  recently  became  Involved  In  the  study  of  solid  mixing,  we  knew  we 
were  invading  an  ancient  field.  This  field  may  reach  back  as  far  as  the  mixing 
of  pigments  for  the  frescoes  of  Laseaux  in  Paleolithic  times. 

The  article  by  S.  S.  Ueidenbaum ,  ^  published  in  1958,  with  73  outstanding 
references  provides  an  excellent  review  of  the  subject  matter.  However,  during 
the  subsequent  three  decades  the  number  of  papers,  books,  and  transactions  at 
national  and  international  conferences  has  reached  such  a  volume  that  a  compre¬ 
hensive  technology  review  must  remain  the  subject  of  a  separate  article.  The 
reader  is  ad^i^^d  to  consult  the  list  of  references  as  a  source  for  detailed 
Information. 

In  the  mixing  process,  two  aspects  are  predominantly  important:  (1)  the 
actual  mechanics  of  mixing  with  its  machinery  and  underlying  complex  theory  and 
(2)  the  quality  control  of  the  homogeneity  or  goodness  of  mixtures.  In  line  of 
principle,  a  comprehensive  theory  of  mixing  would  provide  information  about  the 
goodness  of  mixtures.  However,  at  present,  such  a  theory  does  not  exist  for 
mixing  of  solids,  at  least  not  at  the  level  of  sophistication  which  is  required 
to  predict  homogeneity.  Regarding  characterization  techniques  and  experimental 
measurements  of  the  goodness  of  mixtures  of  solid  particles  Imbedded  in  polymer 
matrices,  we  would  like  to  quote  Rauwendaal^  (p.  323):  "Some  of  the  charac¬ 
terization  techniques  are  quite  sophisticated  and  most  are  very  time  consuming. 
Quantitative  characterization  is  very  important  to  workers  doing  research  on 
mixing.  However,  such  techniques  are  often  Impractical  in  actual  polymer 
processing  operations.  Visual  observation,  although  qualitative,  is  often 
sufficiently  accurate  to  determine  whether  a  product  is  acceptable  or  not." 

Historically,  the  determination  of  the  homogeneity  or  the  goodness  of 
mixtures  is  based  on  a  statistical  approach  whereby  samples  are  taken  at  random 
from  a  batch  of  material.  The  papers  of  P.  V.  Danckwerts^  and  A.  M.  Scott  and 
T.  Bridgewater^®  describe  the  statistical  procedures  comprehensively.  The 
determination  of  the  homogeneity  of,  e.g.,  energetic  materials  using  conven¬ 
tional  statistical  methods,  requires  expensive  chemical  analysis  of  a  large 
number  of  samples  taken  at  random  from  a  single  batch  in  order  to  achieve 
acceptable  error  limits.  The  advent  of  computer  based  image  analysis  systems 
offers  the  possibility  of  automated  determination  of  the  distribution  of  the 
constituents  of  a  thin  sample  layer  drawn  from  a  batch. 
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This  paper  introduces  the  "anthropomorphic”  concept  of  entropy  for  the 
determination  of  the  goodness  of  mixtures. As  will  be  shown,  the  entropy 
concept  is  ideally  suited  for  integration  with  computerized  image  analysis 
systems.  The  concept  of  entropy  has  found,  outside  the  realm  of  thermo¬ 
dynamics,  useful  applications  in  quantum  mechanics  by  J.  von  Neumann. in 
information -theory  by  C.  E.  Shannon  and  W.  Weaver.  ^  and  in  several  other 
fields  .  ”  We  hope  that  the  ideas  developed  in  this  paper  will  contribute  to 

a  scientific  and  quantitative  approach  to  the  problem  of  specification  of  the 
goodness  of  solid  mixtures. 


PARTICLE  DISTRIBUTIONS  OF  SAMPLE  LAYERS 


A  sample  is  drawn  at  a  random  position  from  the  batch  of  a  solid-filled 
polymeric  mixture.  The  sample  size  should  be  large  in  comparison  with  the 
dimensions  of  the  solid  particles  of  the  mixture.  A  rectangular  layer  is  cut 
out  of  the  sample  with  the  help  of  a  microtome  or  some  other  means.  The  layer 
should  be  at  least  twice  as  thick  as  the  largest  particle  class  contained  in  the 
mixture.  The  layer  is  inspected  by  eye  or  preferably  by  an  image  analyzer  and 
the  location  of  all  solid  particles  of  a  specified  class  is  determined.  Figure 
1  depicts  a  computer  generated  representation  of  a  hypothetical  particle 
distribution.  It  has  been  prepared  by  graphically  assigning  200  points  to  pairs 
of  random  numbers. 


ENTROPY  OF  A  POINT  DISTRIBUTION 

Following  the  procedure  described  above,  a  sample  layer  is  reduced  to  a  set 
of  N  points  located  in  a  rectangle  with  sides  a  and  b.  Then,  a  set  of 
coordinates  is  selected  in  such  a  way  chat  the  vertices  A,  B,  C,  and  D  of  the 
rectangle  are  given  by  A(0,0).  B(a,0),  C(a,b)  and  D(0,b). 

To  specify  the  degree  of  order  of  this  set  of  N  points,  we  apply  the 
concept  of  entropy.  We  cover  the  rectangular  set  of  N  points,  representative  of 
the  sample,  with  a  lattice  comprised  of  n  x  m  cells,  where  n  and  m  are  two 
positive  integers,  by  dividing  the  side  a  into  n  parts  and  the  side  b  into  m 
parts.  Each  cell  is  identified  by  two  indices  (i.j)  with  i  -  l....n,  and  j  - 
l....m.  The  point  P(x,y)  is  considered  to  belong  to  the  cell  (i,j)  if  its 
coordinates  satisfy  the  inequalities; 


<i-l)  -  5  X  <  i  - 

n  n 


i  -  1 _ n-1 


(1) 


(J-1) 


b 

m 


<  y  <  j 


b 

m 


j  -  1. . . .m-1 


(2) 


For  i  "  n  and/or  J  -  m,  the  open  inequalities  become  closed, 
as  the  number  of  points  enclosed  in  the  cell  (i,j),  we  have 


If  we  define  n 


ij 


I  nj,  -  N  (3) 

iJ 
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FIGURE  1.  RANDOM  DISTRIBUTION  OF  200  POINTS 
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where  the  sun  Is  understood  to  comprise  all  values  of  1  -  l..,,n  and 
j  -  l....n.  The  frequencies  will  be  defined  by 


■■ij  - 

The  entropy  S„  ,, 
thus,  defined  by 
S 

n,m 


N 

associated  with  the  covering  lattice  of  n  x  rr,  cells 
us  for  two  dimensional  applications; 

■  -I  Pij  In  Pij . 
i.J 


(4) 
is , 

(5) 


Since 


lim  xlnx  -  0,  (6) 

X  0 

for  a  cell  (k,h)  which  contains  no  points,  one  has 

^'k.h  ^k.h  “ 

Because  In  1  -  0 ,  Equation  (7)  holds  if,  and  only  if,  Pj^  is  equal  to  zero  or 
one.  By  using  Equation  (4),  Equation  (5)  reduces  to  the  more  convenient  form: 

Sn.m  -  •  "ij  '^ij  +  1^’-  <8) 

i  J 

Now  we  can  define  the  ideal  homogeneous  distribution  as  follows: 

"A  distribution  of  N  points  is  an  ideal  homogeneous  distribution  if  for  any 
covering  lattice  of  n  x  m  cells,  each  cell  (i,j)  contains  the  same  number  of 
points" ,  i . e . , 

nfj  -  const  i.j(i  -  l...n,  j  -  1.  .m).  (9) 

The  entropy  for  an  ideal  homogeneous  distribution  of  N  points  is  readily 

calculated  since  one  has 

N 

ni  r  -  -  -  const.  (10) 

ij  n  X  m 

Thus,  one  derives  from  equation  (8)  and  (10): 

S^®^n,m  “ 

In  the  space  (n,m,S),  Equation  (11)  defines  an  entropy  surface  which  is 
depicted  in  Figure  2.  For  an  ideal  homogeneous  distribution,  the  entropy 
surface  is  perfectly  smooth.  This  is  no  longer  the  case  when  deviations  occur 
from  the  ideal  distribution.  This  can  readily  be  seen  in  Figure  3  which  depicts 
the  entropy  surface  for  the  random  distribution  of  200  points  of  Figure  1.  In 
Figure  4,  the  same  200  points  have  been  located  in  the  upper  right  hand  corner 
of  the  rectangular  grid.  Figure  5  shows  the  roughness  of  t>'^  corresponding 
entropy  surface. 
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FIGURE  3.  ENTROPY  SURFACE  FOR  A  RANDOM  DISTRIBUTION  OF  200  POINTS 
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FIGURE  4.  EXTREME  INHOMOGENEOUS  DISTRIBUTION  OF  200  POINTS 
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FIGURE  5,  ENTROPY  SURFACE  FOR  AN  EXTREME  INHOMOGENEOUS 
DISTRIBUTION  OF  200  POINTS 
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We  have  shown  for  an  ideal  homogeneous  discribucion  that  the  entropy 
m  does  not  depend  on  the  number  of  points  but  only  on  the  number  of 
cells!  It  must  be  pointed  out,  however,  that  this  is  not  generally  true.  By 
increasing  the  number  of  cells,  a  point  is  reached  at  which  each  cell  contains 
only  one  point,  l.e.,  the  number  of  cells  is  equal  to  the  number  of  points: 

n  X  m  -  N  (12) 


When  this  stage  has  been  reached,  any  further  increase  in  n  and/or  m  has  only 
the  effect  of  introducing  empty  cells.  Since  the  partial  entropy  of  an  empty 
cell  is  zero,  the  maximum  entropy  is  reached  when  condition  (12)  is  satisfied. 
Correspondingly,  if  n^  -  1  the  first  term  of  the  right  side  of  Equation  (8) 
goes  to  zero  and  the  maximum  entropy  is  given  by: 

This  is  true  for  any  point  distribution.  In  fact,  it  is  always  possible  to  find 
a  lattice  fine  enough  so  that  each  cell  contains  at  most,  one  point.  In  other 
words,  for  any  distribution  of  points,  the  entropy  reaches  a  maximum  given  by: 

Sr. ./max  - 

It  must  be  mentioned  that  Sj..^  m./m.ax  ^  larger  num.ber  of  cells  than 

m/max'  Since  the  square  is  the  most  sjTnmetr ical  parallelogram,  we  select 
square  samples  and  square-cell  lattices,  i.e.,  n  •  m.  The  lattice 


which  satisfies  condition  (12)  and  the  relation: 

n  -  m  - 


will  be  called  "comparison  lattice",  whereby 
integer  i  /N . 


(15) 

defines  the  smallest 


4S  A  MEASURE  OF  INHO.MOGENEITV 

As  a  measure  of  inhomogeneity,  we  define: 

-SS  -  -  S„.„(N).  (16) 

whereby  S(N)  is  calculated  for  the  comparison  lattice  in  accordance  with 
Equations  (12)  and  (15). 

By  combining  Equations  (8)  and  (13)  one  derives: 

n 

4S  -  ^5]  n^j  In  nj^j  (17) 

i.J-1 
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4S  represents  a  measure  of  inhomogeneity  based  upon  the  comparison  lattice  which 
is  determined  by  the  total  number  of  particles  of  a  component  present  in  the 
rectangular  sample  layer.  As  discussed  above,  the  entropy  S  is  a  function  of  N, 
the  total  number  of  particles  in  a  sample  layer  and  the  number  of  cells.  In 
Figures  6  and  7,  the  entropy  curves  and  are  plotted  as  a  function 

of  the  number  of  cells  for  N  -  200.  The  corresponding  comparison  lattice  is 
calculated  from  relation  (15); 


Figures  6  and  7  show  that  the  entropy,  for  the  ideal  homogeneous 

distribution  reaches  a  plateau  at  values  n  a  15.  The  entropy  curves  S  of 
Figures  6  and  7  represent  the  intersections  of  the  entropy  surfaces  shown  in 
Figures  3  and  5  for  square  cells,  i.e.,  n  •  m.  The  corresponding  point 
distributions  are  displayed  In  Figures  1  and  4.  The  AS  functions  reach  a 
maximum  in  the  vicinity  of  n  -  15. 

ENTROPY  OF  A  SAMPLE  BATCH 

The  previous  analysis  permits  a  quantitative  evaluation  of  the  degree  of 
deviation  of  an  actual  particle  distribution  from  an  ideal  distribution.  The 
calculation  of  AS  requires  that  the  number  of  particles  and  reference  points  be 
equal.  If,  however,  several  samples  are  taken  from  a  given  batch,  the  values  of 
AS,  calculated  in  accordance  with  Equation  (17),  provide  inaccurate 
information.  This  is  because  each  sample  contains,  in  general,  a  different 
number  of  particles  and  the  AS's  would  be  Inconsistent.  Since  it  is  desirable 
that  the  number  of  particles  in  the  test  samples  and  in  the  reference 
distribution  are  equal,  a  method  for  calculating  AS  for  a  sample  batch  was 
developed  which  can  be  used  to  adjust  the  number  of  particles  of  the  sample 
batch  to  the  number  of  particles  of  the  reference  distribution. 

2 

Assume  K  samples  are  taken  at  random  from  a  given  batch;  whereby  K  is  a 
positive  Integer  defined  by  a  given  test  plan.  The  samples  are  squares  having 
sides  of  a  specified  length.  The  samples  are  randomized  and  arranged  in  a  K 
X  K  matrix.  Then,  the  matrix  is  analyzed  with  the  .same  algorithm  developed  in 
the  previous  section,  i.e.,  AS  will  be  calculated  for  the  K  x  K  matrix  in 
accordance  with  Equation  (17),  A  typical  calculation  is  presented  in  Figures  8 
through  12 . 


CONCLUSION 

This  paper  describes  an  algorithm,  based  on  the  concept  of  entropy,  for  the 
evaluation  of  homogeneity  of  a  dispersion  of  particles  in  a  solid  mixture.  The 
algorithm  is  ideally  suited  for  modern  computer  assisted  image  analysis  systems 
in  quality  control  of  solid  mixtures.  The  application  of  this  algorithm  for 
quality  control  analysis  based  on  specific  selection  criteria  will  be  the 
subject  of  a  forthcoming  paper. 
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FIGURE  6.  ENTROPY  VERSUS  n  WHEN  n  =  m  FOR  A  RANDOM  DISTRIBUTION  OF 
200  POINTS 
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FIGURE?.  ENTROPY  VERSUS n  WHEN  n  =  mFOH  AN  EXTREME  INHOMOGENEOUS 
DISTRIBUTION  OF  200  POINTS 
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FIGURE  8.  POINT  DISTRIBUTION  IN  NINE  2x2  SAMPLES 
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FIGURE  9  TRANSLOCATION  OF  POINTS  FROM  THE  NINE  SAMPLES  INTO  A  6x6  MATRIX 
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